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Abstract 

Synchronization phenomena are pervasive in biology. In neuronal networks, the mechanisms of syn- 
chronization have been extensively studied from both physiological and computational viewpoints. The 
functional role of synchronization has also attracted much interest and debate. In particular, synchroniza- 
tion may allow distant sites in the brain to communicate and cooperate with each other, and therefore it 
may play a role in temporal binding and in attention and sensory-motor integration mechanisms. In this 
article, we study another role for synchronization: the so-called "collective enhancement of precision." 
We argue, in a full nonlinear dynamical context, that synchronization may help protect interconnected 
neurons from the influence of random perturbations ~ intrinsic neuronal noise - which affect all neurons in 
the nervous system. This property may allow reliable computations to be carried out even in the presence 
of significant noise (as experimentally found e.g., in retinal ganglion cells in primates), as mathematically 
it is key to obtaining meaningful downstream signals, whether in terms of precisely-timed interaction 
(temporal coding), population coding, or frequency coding. Using stochastic contraction theory, we show 
how synchronization of nonlinear dynamical systems helps protect these systems from random pertur- 
bations. Our main contribution is a mathematical proof that, under specific quantified conditions, the 
impact of noise on each individual system and on the spatial mean can essentially be cancelled through 
synchronization. Similar concepts may be applicable to questions in systems biology. 

Author Summary 

Synchronization phenomena are pervasive in biology, creating collective behavior out of local interactions 
between neurons, cells, or animals. Many of these interactions occur in the presence of large amounts of 
noise or disturbances, making one wonder how meaningful behavior can arise in these highly uncertain 
conditions. In this paper we show mathematically, in a very general context, that synchronization is 
not just robust to the deleterious effects of noise and disturbances: it actually protects subsystems from 
them. In effect, synchronization makes subsystems work as a team in fighting noise and successfully 
achieving their target behavior. One mechanism for strong synchronization is for subsystems to jointly 
create and then share a common signal, such as a mean electrical field or a mean chemical concentra- 
tion, in effect making each subsystem directly connected to all others. Conversely, extracting meaningful 
information from average measurements over populations of cells (as commonly used for instance in 
electro-encephalography, or more recently in brain-machine interfaces) may require the presence of syn- 
chronization mechanisms similar to those we describe. 

Introduction 

Synchronization phenomena are pervasive in biology. In neuronal networks |34[ l2l |40]. a large number 
of studies have sought to unveil the mechanisms of synchronization, from both physiological pir, and 
computational viewpoints [see for instance '30! and references therein]. In addition, the functional role of 
synchronization has also attracted considerable interest and debates. In particular, synchronization may 
allow distant sites in the brain to communicate and cooperate with each other [31 0S] and therefore 
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may play a role in temporal binding |18} |9] and in attention and sensory-motor integration mechanisms 



In this article, we study another role for synchronization: the so-called collective enhancement of 
precision [see e.g. l33ll5^l24j . an intuitive and often quoted phenomenon with comparatively little formal 
analysis |43j . We explain mathematically why synchronization may help protect interconnected nonlinear 
dynamic systems from the influence of random perturbations. In the case of neurons, these perturbations 
would correspond to so-called "intrinsic neuronal noise" [see for instance [T^], which affect all of the 
neurons in the nervous system. In the presence of significant noise intensities (as experimentally found 
in e.g. retinal ganglion cells in primates [6 ), this property would be required for meaningful and reliable 
computations to be carried out. 

In general, the behavior of a nonlinear dynamical system can be dramatically affected by the presence 
of noise, as e.g. in chaotic systems. However it has been shown analytically that some limit-cycle 
oscillators commonly used as simplified neuron models, such as FitzHugh-Nagumo (FN) oscillators, are 
basically unperturbed when they are subject to a small amount of white noise |41j . Yet, a larger amount 
of noise breaks this "robustness", both in the state space and in the frequency space (Figures 1(A)-(D)). 
This suggests that both temporal coding and frequency coding may be unusable in the context of large 
neuronal noise. 

One might argue that it could be possible to recover some information from the noisy FN oscillators 
by considering the activities of a large number of oscillators simultaneously [71[T2]. Figure 2(A) shows 
that the spatial mean of the noisy oscillators still carries very little information when the noise intensities 
are large, making the population coding hypothesis also unlikely in this context. In other words, if the 
underlying dynamics are fundamentally nonlinear, as in the case of our FN oscillators, the spatial mean of 
the signals is "clean," but the nonlinear nature of the systems dynamics prevents the familiar "averaging 
out" of noise through multiple measurements. 

By contrast, one can observe that when oscillators are synchronized through mutual couplings, then 
they become "protected" from noise, whether in temporal (Figure 1(E)), frequential (Figure 1(F)) or 
"populational" aspects (Figure 2(B)). Thus, in some sense, the linear effect of averaging noise while 
preserving signal [16] can be achieved for these highly nonlinear dynamic components through the process 
of synchronization. Our aim in this article is to give mathematical elements of explanation for this 
phenomenon, in a full nonlinear setting. It is also to suggest elements of response to a more general 
question, namely: what is the precise meaning of ensemble measurements or population codes, and what 
information do they convey about the underlying dynamics and signals? 

Results 

General analytical result 

Consider a diffusive network of d-dimensional noisy non-linear dynamical systems 



where f = [fi, . . . , fd)'^ is a M'* ^ M"^ function. Note that the noise intensity a is intrinsic to the 
dynamical system (i.e. independent of the inputs), which is consistent with experimental findings [6]. 
For simplicity, we set tr to be a constant in this article, although the case of time- and state-dependent 
noise intensities can be easily adapted from [51] . 

We consider four hypotheses that will enable us to relate the trajectory of any noisy element of the 
network x.^ to the trajectory of the noise-free system Xnoiso-frcc driven by equation 



[HIMlll^. 




(1) 



■noise- free 



f(x, 



■noise-: 
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Hypothesis (HI) is an assumption on the form of the network. (H2) gives a bound on the nonlinearity 
of the dynamics f . (H3) states that f is robust to small perturbations. Finally, (H4) requires that the 
dynamical systems in the network are synchronized. 

(HI) The network is balanced, that is, for any element of the network, the sum of the incoming connection 
weights equals the sum of the outgoing connection weights 



1 3 

In particular, any symmetric network is balanced. 

(H2) Let Hj denote the Hessian matrix of the function fj and let A,„ax(Hj) denote its largest eigenvalue. 
For all j, we assume that A,nax(Hj) is uniformly upper-bounded by a constant ^||H||. This implies 
in particular that 

Vx,j,i x^H,x< H||x||2. 

This hypothesis gives us a bound on the nonlinearity of f, the extreme case being ||H|| ~ for a 
linear system. 

(H3) The dynamics f is robust to small perturbations. More precisely, consider two systems starting 
from the same initial conditions but driven by slightly different dynamics 



^noisc— tree 



f (-^noise-free ; ^) 

and 

-^perturbed ^ (-^perturbed i ^) ~t~ 
then E(||P||)^0 implies ||Xnoise-free - XporturbedH ^ 0. 

In particular, such a property has been demonstrated in the case of FN oscillators, with P repre- 
senting a white noise process |41j . 

(H4) After exponential transients, the expected sum of the squared distances between the states of the 
elements of the network is bounded by a constant p 




This is where synchronization will come into play, because synchronization is an effective way to 
reduce the bound p. Some precise conditions for this will be given later. 

We show in Methods that under these hypotheses and when n — s- cx) and p/n^ 0, the distance between 
the trajectory of any noisy element x^ of the network and that of the noise-free system x,ioise-free tends 
to zero, with the impact of noise on the mean trajectory evolving as 

Pl|H!| , a 



2?i2 



In particular, when f is a time-varying linear system of the form f(x,t) = A(t)x -I- b(t), we recover the 
known result [10] that the impact of noise evolves as the inverse square root of n. More generally, linear 
components of the system dynamics (including, in particular, the input signals) do not contribute to the 
first term of the above upper bound. 
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Synchronization in networks of noisy FN oscillators 



We now give conditions to guarantee hypothesis (H4) for all-to-all networks of FN oscillators with identical 
couplings. The dynamics of n noisy FN oscillators coupled by (gap-junction-like) diffusive connections is 
given by 

f dv, = (cf{v^, w„ I) + J2j T[ivj - v^)j dt + adW, 
I dwi — — — a + bwijdt 



(2) 



where f{v, w, I) 



/. We show in Methods that, after transients of rate k, 




< 



n{n — 1)ct^ 



k 



Thus, (H4) is verified with 



P = 



(3) 



(4) 



For large n, we have p/ri^ ^ <^'^ jk, which converges to when k ^ oo (see Figure 3(A)). 

Hypothesis (HI) is also verified because an all-to-all network with identical couplings is symmetric, 
therefore balanced. Since the {vi,Wi)'^ are oscillators with stable limit cycles, it can be shown that the 
trajectories of the are bounded by a common constant M. Thus (H2) is verified with ||H|| — 2cM. 
Finally, (H3) may be adapted from f3T. Indeed, we believe that the arguments of [H] can be extended 
to the case of non- white noise. Making this point precise is the subject of ongoing work. 

Using now the "general analytical result", we obtain that, given any (non necessarily small) noise 
intensity a, in the limits for k oo and n oo and after exponential transients, the behavior of any 
oscillator will be arbitrary close to that of a noise-free oscillator (Figure 1). 

This statement can be further tested by constructing a model-based nonlinear state estimator (ob- 
server) |25j . Let (vi^Wi)^ be a noisy synchronized oscillator and consider the observer 



fobs = c/(Wobs, "iWobs, I) + kohs{Vi - Vohs) 
Wohs = -l{Vohs~a + bWohs)- 



(5) 



If Vi has the same trajectory as a noise-free FN oscillator, then it can be shown that (I'obsi 'U'obs)"^ 
tends exponentially to {vi,'Wi)'^, independently of the observer's initial conditions [25]. Thus the squared 
distance {vohs — Vi)^ indicates how close Vi is from a noise- free oscillator (Figure 3(B)). 



Some extensions and other examples 

We provide in this section some ideas and simulation results which show the genericity of the concepts 
presented above. However, the full mathematical explanation for some results is still under development. 



Probabilistic networks. In practice, all-to-all neuronal networks of large size are rare. Rather, the 
mechanisms of neuronal connections in the brain are believed to be probabilisitic in nature [see 1351 for a 
review]. Here, we consider a probabilistic symmetric network of n oscillators, where any pair of oscillators 
has probability p to be symmetrically connected and probability 1 to be unconnected. Figure 4 shows 
simulation results for p = 0.1. 
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Quorum sensing. In system biology, quorum sensing [T5l|37]), where individual cells measure mean 
chemical concentrations in their environment, may be seen as a mechanism implementing all-to-all cou- 
pling. For instance, assuming that the mean value of the x^'s can be provided by the environment as 
X* = ^ X^i^i' then, the all-to-all network (jlj with K^i — Jti can be written as a star network where 
damping is added locally and each cell x.^ is only connected to the common signal 

rfx, = (f (xj, t) + nJ^^(x* - Xj)) dt + adW^. (6) 

Quorum sensing, and more generally the measurement of a common mean signal, can thus be seen as a 
practical (and biological plausible) way to implement all-to-all coupling with 2n connections instead of 

2 

n . 

Hindmarsh-Rose oscillators. Hindmarsh-Rose oscillators are three-dimensional dynamical systems 
that are also often used as neuron models 

dV = {I~n~-m-V^+gvV + EvV^)dt + adW 
dn = {GNa + ENaV^ - n)dt 
dm = (gcaiEcaiV + Vconst) - ■m))dt 

with gv = 0.5; Ey = 2.8; GNa = 0; ENa = 4.4; gca = 0.001; Eca = 9; Vconst = 7/EGa. These oscillators 
can exhibit more complex behaviors (including spiking and bursting regimes |22] ) than FitzHugh-Nagumo 
oscillators. The proofs of (H3) and (H4) for Hindmarsh-Rose oscillators are the object of ongoing research. 

We made the inputs time-varying in this simulation. In fact, all the previous calculations can be 
straightforwardly extended to the case of time- varying inputs, as long as those inputs are the same for 
all the oscillators [see [30] . 

One can observe from the simulations (see Figure 5) that the synchronized oscillators let the inputs' 
signal through, while the uncoupled oscillators completely blur the signal out. 



Discussion 

We have argued that synchronization may represent a fundamental mechanism to protect neuronal as- 
semblies from noise, and have quantified this hypothesis using a simple nonlinear neuron model. This 
may further strengthen our understanding of synchronization in the brain as playing a key functional 
role, rather than as being mostly an epiphenomenon. 

It should be noted that the causal relationship studied here - effect of synchronization on noise - 
is converse to one usually investigated formally in the literature - effect of noise on synchronization: 
destructive effect [38]; constructive effect [26l [39]; for a review, see [iT]. Also, previous papers have 
studied a similar phenomenon of improvement in precision by synchronization. Enright jlOj shows 
improvement in a model of coupled relaxation oscillators, all interacting through a common accumulator 
variable (possibly being the pineal gland). This y/n improvement has been experimentally shown in 
real heart cells More recently, [27| shows a way to get better than improvement. However, 
their studies primarily focused on the case of phase oscillators, which are linear dynamical systems. In 
contrast, we concentrate here on the more general case of nonlinear oscillators, and quantify in particular 
the effect of the oscillators' nonlinearities. The hypotheses we consider are also different: while most 
existing approaches (including (author?) [27]) assume weak couplings and small noise intensities, we 
consider here strong couplings and arbitrary noise intensities. 

The mechanisms highlighted in the present paper may also underly other types of "redundant" cal- 
culations. In otoliths for instance, ten of thousands of hair cells jointly compute the three components 
of acceleration (231 [Sj- In muscles, thousands of individual fibers participate in the control of one single 
degree of freedom. Similar questions may also arise in systems biology, e.g., in cell mechanisms of quorum 
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sensing where individual cells measure mean chemical concentrations in their environment in a fashion 
functionally similar to all-to-all coupling |15l I37j . in mechanical coupling of motor proteins |19j . in the 
context of transcription- regulation networks [T], and in differentiation dynamics [36 . 

Finally, the results point to the general question: what is the precise meaning of ensemble measure- 
ments or population codes, what information do they convey about the underlying signals, and is the 
presence of synchronization mechanisms (gap-junction mediated or other) implicit in this interpretation? 
As such, they may also shed light on a somewhat "dual" and highly controversial current issue. Ensemble 
measurements from the brain can correlate to behavior, and they have been suggested e.g. as inputs to 
brain-machine interfaces. Are these ensemble signals actually available to the brain |13j, perhaps through 
some process akin to quorum sensing, and therefore functionally similar to (local) all-to-all coupling? Are 
local field potentials [29 plausible candidates for a role in this picture? 

Methods 

Proof of the general analytical result 

In the noise-free case (cr = 0), it can be shown that, for strong enough coupling strengths, the elements 
of the network synchronize completely, that is, after exponential transients, we have p = in (H4) [30j . 
Thus, all the tend to a common trajectory, which is in fact a nominal trajectory of the noise-free 
system x„oise-froG — f (xnoise-free) i)i becausc all the couplings vanish on the synchronization subspace. 

In the presence of noise, it is not clear how to relate the trajectory of each to a nominal trajectory 
of the noise-free system. Nevertheless, we still know that the x^ live "in a small neighborhood" of each 
other, as quantified by (H4). Thus, if the center of this small neighborhood follows a trajectory similar 
to a nominal trajectory of the noise-free system, then one may gain some information on the trajectories 
of the X,;. 

To be more precise, let x* be the center of mass of the x^, that is 




(7) 



Observe that, after expansion and rearrangement, 
the distances of the Xj from x* 



the sum X]i<i ll^i ^ ^jlP '^^^ t)e rewritten in terms of 



n 



Ell 



x,-x*f. 



i<j 



Using (114) then leads to 




(8) 



Summing over i the equations followed by the Xj and using hypothesis (HI), we have 




(9) 



We now make the dynamics explicit with respect to x* by letting 




(10) 
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so that equation (|9| can be rewritten as 

dx* = (f(x*,t) -e)(ii+ -V crdW,. (11) 



Using the Taylor formula with integral remainder, we have 

/,(x„f) ~ /,(x%<) - F,(x*,t)^'(x, -X*) 



(1 - s)(x, - x*)^H,((l - s)x, + sx*)(x, - x*)ds 



(12) 



where F, is the gradient of or, equivalently, the j vector of the Jacobian matrix of f . Summing 



Equation (12) over i and using hypothesis (H2), we get 



^(/,(x„t) - /,(x-,i))| < ^ E 11^' - ^'ll'- (13) 



Summing now inequahty (13) over j and using inequahty iSh, we get 



E(||e||) < « (14) 



which implies that E(||e||) when p/n'^ 0. 



Turning now to the noise term ^ adWi in Equation (11 1, we have 



(15) 



since the intrinsic noises of the elements of the network are mutually independent. 

Thus, for a given (even large) noise intensity cr, the difference between the dynamics followed by x* 
and the noise-free dynamics f tends to zero when n — > cx3 and p/n^ 0. Hypothesis (H3) then implies 
that ||x* — Xnoisc-frccll ~* 0- Furthermore, the impact of noise on the mean trajectory evolves as 

If - j,^ 

Finally, Equation ([s]) and the triangle inequality 

:*ll + !|x--x,|l (17) 



^noisc-lrcc 



imply that the trajectory of any synchronized element of the network x^ and that of the noise-free system 
Xnoiso-frcc are also similar (compare Figure 1(A) and Figure 1(E)). 

FN oscillators in an all-to-all network 

Two FN oscillators. Consider first the case of two coupled FN oscillators driven by Equation ([2|. 
Construct the following auxiliary system (or virtual system, in the sense of [42,), where vi and V2 are 
considered as external inputs 

dxi = ((c — {vf + V1V2 + V2) — k)xi + CX2)) dt 

+ ^/2adW (18) 
dx2 = {-\xi - 2X2) dt. 

Remark that (xi, X2)^ = (wi — Wi — W2)^ is a particular trajectory of this system. 
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Let Ai = fc + {vf + V1V2 + V2) — c and A2 — b/c. Assume that the coupHng strength is significantly 
larger than the system's parameters, i.e. k ^ c, k ^ 1/c and k ^ b/c. Since vf + viV2 + V2 is nonnegative 



for any vi and V2, we have either Ai > fc or Ai ~ fc, depending on the actual value of vf - 
implies in particular that Ai S> c, Ai 3> 1/c and Ai 3> A2 = b/c. 



'V1V2- 



This 



Given these asymptotes, the evolution matrix of system (18 1 is diagonalizable with eigenvalues —X'^ 
and — A2 and eigenvectors respectively (A'/,l/c)-^ and (c, A"') , where Ai ~ A ■ ~ A-' ~ A-" {i = 1,2). 
Define now 



(19) 



yi = A'/xi + -X2 

1)2 = CSi + \'1'X2 

leading to 

dyi = -X[yidt + V2aX'{dW 
dy2 = -X'2y2dt+ V2acdW. 

Since these equations are in fact uncoupled, they can be solved independently. Using the stochastic 
contraction results (corollary 1 of 31J) and the approximations Ai ~ AJ ~ A", this yields 

^{yi) 1^ cr^-^i: after transients of rate Ai 



E(yi 



- A2 ■ 



after transients of rate A2. 



These bounds can be translated back in terms of the Xi by inverting (19 1 



Thus, after transients of rate Ai, 



^1 - Aiyi - aY2^2 

x2^-^yi + ^^y2- 



E{xl) < 



Ai 



E(x^) < -2 



XIX2 



Since {vi — V2,wi — 1^2)^ is a particular trajectory of system (18 1 as we remarked earlier, one finally 
obtains that, after transients of rate fc. 



E((fi - V2) 



< 



E{{wi-W2f) < 



bk^ 



(20) 



General case. Consider now an all-to-all network with identical couplings as in Equation ([2|. Con- 
struct as above the following n{n — 1) auxiliary systems indexed by G [1 . . where the Vi are 
considered as external inputs 

dvij = ((c — {vf + ViVj + u|) — k)vij + cwij)) dt 
+^/2(jdW 



dt. 



^ \ c "'^3 c 

Remark that, similarly to the case of two oscillators, {{vij yWij)"^) . . — ((wi — Vj,Wi — Wj)^)^ . is a par- 
ticular solution of these equations. Remark also that each pair {vij,Wij) is in fact uncoupled with respect 
to other pairs. This allows us to use (20) to obtain that, after transients of rate fc. 



Summing over the i,j yields 



V»,j, i 7^ J, E((w, 



a 

~k 




{vi -VjY' 



< 



n{n — 1)(T^ 



(21) 
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Thus, (H4) is verified with 

n{n - 1)0-^ 

P= ^ ■ (22) 

For large n, we have p/n? cr'^/fc, which converges to when k ^ 00 (see Figure 3(A)). 

Hypothesis (HI) is also verified because an all-to-all network with identical couplings is symmetric, 
therefore balanced. As for (H2), observe that Hu, = and 



H„ 



2cv 




Since the {vi,Wi)'^ are oscillators with stable limit cycles, it can be shown that the trajectories of the Vi 
are bounded by a common constant M. Thus (H2) is verified with ||H|| = 2cM. Finally, (H3) may be 
adapted from jU]. Indeed, we believe indeed that the arguments of [41 J can be extended to the case of 
non- white noise. Making this point precise is the subject of ongoing work. 
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Figure 1. Simulations of a network of FN oscillators using the Euler-Maruyama algorithm 

[21| . The dynamics of coupled FN oscillators are given by equation ([2|. The parameters used in all 
simulations are a = 0.3, b = 0.2, c = 30. (A) shows the trajectory of the "membrane potential" of a 
noise-free oscillator and (B) depicts the frequency spectrum of this trajectory computed by Fast Fourier 
Transformation. (C) and (D) present the trajectory (respectively the frequency spectrum) of a noisy 
uncoupled oscillator (cr = 10). (E) and (F) show the trajectory (respectively the frequency spectrum) of 
a noisy synchronized oscillator within an all-to-all network (cr = 10, kij = 5, n — 200). Note the 
temporal and frequential similarities between a noise-free oscillator and a noisy synchronized one. For 
instance, the main frequency and the first harmonics are very similar in the two frequency spectra. In 
contrast, the frequency spectrum of a noisy uncoupled oscillator shows no clear harmonics. 
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Figure 2. "Spatial mean" of FN oscillators. Note that the same set of random initial conditions 
was used in the two plots. (A) shows the average "membrane potential" computed over n = 200 noisy 
uncoupled oscillators (ct = 10). (B) shows the average "membrane potential" computed over n — 200 
noisy synchronized oscillators within an all-to-all network (cr = 10, fc^ — 5). Observe that, in the first 
plot, the average trajectory of uncoupled oscillators carries essentially no information, while in the 
second plot, the average trajectory of synchronized oscillators is very similar to a noise-free one. 




Figure 3. Asymptotic appraisal of the theoretical bounds. Note that the experimental 
expectations were computed assuming the ergodic hypothesis. (A) Expectation of the average squared 
distance between the u^'s and v* (given by ^EX]i(^i ~ ^*)^) ^ ^ function of the coupling strength kij 

(71— Da^ 

• = 10). Theoretical bound ^^^2^ (cf equations (8) and (22 
line), for n = 200 (dashed line); simulation results for n 



)) for n = 10 (bold line), for n — 50 (plain 
squares) , for n — 50 (triangles) , for 



n = 200 (crosses). (B) Expected squared distance between a noisy synchronized oscillator and its 
observer (given by (wobs — ^i)'^) as a function of n (cr = 10, kij = 5). The bound ^\^]}.'^ was plotted in 
plain line and the simulation results were represented by crosses. 
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Figure 4. Simulation for a probabilistic symmetric network (n = 200, p = 0.1, a = 10, kij = 5). 

(A) shows the trajectory of the "membrane poteiitiar' of an oscillator in the network. (B) shows its 
frequency spectrum. Compaxe these two plots with those in Fig. 1. 
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Figure 5. Simulation of Hindmarsh-Rose oscillators with time varying inputs. (A) The 

time-varying input voltage. (B) Trajectory of the "membrane potential" of a noise-free oscillator. (C) 
Trajectory of a noisy uncoupled oscillator. (D) Trajectory of a noisy synchronized oscillator (n = 200, 
a = 10, kij = 5). 



